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Abstract. Non-Markovian local in time master equations give a relatively simple way 
to describe the dynamics of open quantum systems with memory effects. Despite their 
simple form, there are still many misunderstandings related to the physical applicability 
and interpretation of these equations. Here we clarify these issues both in the case of 
quantum and classical master equations. We further introduce the concept of a classical 
non-Markov chain signified through negative jump rates in the chain configuration. 
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1. Introduction 

The interaction of a quantum system with its environment causes the dynamics to be 
non-unitary: the evolution of the state of the open quantum system can no longer 
be described by the Schrodinger equation but a master equation is needed in order 
to characterize dissipation and decoherence effects. Since merely all realistic quantum 
systems are open, i.e., they are influenced by their surroundings, the description of such 
dynamics is crucial for our understanding of the nature. Therefore, the fundamental 
issues of open quantum systems as well as their mathematical description have gained 
a large amount of interest in the recent years [HElElilEllSllZllEllSllIDllIIllEllI^. 

The standard approach to the dynamics of open quantum systems, which employs 
the concept of a quantum Markov process, was developed already in the seventies [T^[TB] 
and has been successfully applied in modeling many quantum systems [161 HZ] • For a 
quantum Markov process the dynamics is given by a semigroup of completely positive 
dynamical maps and the corresponding master equation describing the dynamics is in 
the Lindblad form. The simple structure of the master equation allows a straightforward 
treatment of the dynamics of the open system whenever memory effects play no role in 
the dynamics. 

However, for many processes occurring in the nature the approximations allowing 
the Markovian treatment are not valid. For example, strong system-environment 
coupling, structured or finite reservoirs and low temperatures can give rise to pronounced 
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memory effects in the dynamics of the open system and these systems require a 
more sophisticated non-Markovian treatment. The increasingly important role of non- 
Markovian processes has initiated significant steps towards a general consistent theory 
of non-Markovian quantum dynamics [3j HJ 13 EJ [7] as well as achievements in the 
experimental detection and control of memory effects [TS1 \W\ . 

The vast interest in memory effects in quantum processes has led into many 
mathematical formulations of the dynamics beyond the Markov theory as well as a 
large variety of tools for solving the dynamics. Probably the most common ones of these 
methods apply memory kernel master equations [TJ [HJ [201 EI] or local in time master 
equations [TJ [22] • The local in time master equations give a mathematically rather 
simple method for dealing with memory effects and they have been applied to describe 
a variety of non-Markovian processes in nature [21 EH [331 EH ES]- Despite the simple 
form, there are still many misunderstandings related to the physical applicability and 
interpretations of these equations. Here we pinpoint and clarify some of these misbeliefs 
about the local in time description and give some illustrative examples to further explain 
these points. 

The structure of the paper is as follows. In section [2] we introduce the formulation 
of non-Markovian dynamics in terms of local-in-time master equations and specify the 
connection between the quantum and classical cases. We further connect the local in 
time equation to a quantum jump description [261 EZ], allowing an interpretation for 
negative decay rates in the equation. In section [3] we discuss three different points 
regarding the local in time description, which are often misunderstood, and give some 
illustrative examples to rebut these misbeliefs. Section [| introduces a description of a 
classical non-Markov chain, where memory effects play a crucial role. 

2. Local in time master equations 

For a Markovian quantum process the dynamics is given by a semigroup of completely 
positive dynamical maps and the corresponding master equation for the reduced density 
matrix p(t) describing the dynamics is in the Lindblad form 



where if is a Hermitian operator, 7, are the decay rates, which are positive constants, 
and Li are the Lindblad operators. 

The standard approach to the non-Markovian dynamics of open systems uses the 
Nakajima-Zwanzig projection operator technique [201 EI] from which one obtains the 
memory kernel master equation 



in which quantum memory effects are taken into account through the introduction of 
the memory kernel K,(t). Since the master equation is not local in time due to the 
integration over the density matrix p, it is usually taken as granted that a master 
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equation of this form guarantees the occurrence of memory effects in the dynamics. 
However, the form of a master equation is not in general unique, i.e., the dynamics can 
be described equivalently by another type of master equation, which is local in time 
[28]. More precisely, it was shown in [HI H2], that under fairly general assumptions, the 
master equation of the form of equation ^ can always be cast into a local in time form 

~p{t) = C(t)p(t), 

in which no memory kernel occurs. Further, any time-local master equation can be cast 
in a Lindblad-like form of equation Q, but with time dependent Lindblad operators 
as well as time dependent decay rates 7»(t) which may also become negative for some 
intervals of time [131 [29]. Thus, non-Markovian dynamics can be written in the local in 
time form 

j t p{t)= -i[H(t),p(t)\ (3) 

with temporarily negative decay rates ji(t). Master equations of this form have been 
frequently applied in the context of non-Markovian systems, but there are still some 
misunderstandings related to their applicability. Before going into details of these 
common misunderstandings in section [3] let us first introduce some aspects related to 
these equations, which will allow us to explain our arguments in the following sections. 



2.1. Quantum and classical master equations 

The master equation (|3| describes a general quantum process, which reduces to a 
standard quantum Markov process whenever the decay rates ji(t) are positive constants 
and the Lindblad operators are independent of time. Also, as a special case, one can 
obtain the classical rate equation under certain assumptions as we will show here. 

Let us first assume that the Hamiltonian of the system is time- independent and it 
has the spectral decomposition H = J2k Ek IV'fe) (0fc|> where E k are the eigenenergies and 
\ipk) the eigenvectors of the Hamiltonian. Now assume, that the system is described by 
a classical probability distribution instead of the quantum mechanical density matrix, 
i.e., the density matrix can be written as a diagonal matrix in the system eigenbasis 
pit) = J2kPkit) \i>k) {ipk\, where Pkit) gives the occupation probability of the eigenstate 
\ipk) at time t. Now, if we assume, that the Lindblad operators Lj in equation (|3]) 
describe transitions from one eigenstate to another = L^i = \ipk) (ipi\ such that / ^ k 
we obtain 

j t pit)= -i[H,p(t)} 

+ EE7«(i) Ukipml - UlILu, pit)}) 

k l^k V A J 

= ££7«(*) ipi(t) m M-m(t) m> m 

k l^k 



Local in time master equations 



4 



= 2 l^fc) (V>fc| S hkl(t)pi(t) - Jlk(t)pk{t)) , 
k l^k 

from which one obtains the rate equation 

Vk{t) = E (lki{t)Pi(t) - 7ik(t)Pk(t)) , (4) 

which can also be cast into a more compact form 

P(t) = P(t) T Q(t), (5) 

where P(t) is the column vector with elements Pk(t) and Q(t) is a matrix with elements 
9fei(0 = 7jw(^) for A; 7^ / and qu = — k^i Ilk- Whenever the decay rates are positive 
constants equations Q and ^ describe the well known continuous in time Markov 
chain. However, if the decay rates can be temporarily negative these equations no 
longer describe a Markov chain but rather a classical non-Markovian process. In the 
following chapters we will study further such classical non-Markovian processes as well 
as clarify the interpretation of negative rates in the classical realm. Before that, let us 
study more the interpretation of negative decay rates in the quantum case. 



2.2. Master equations and jump descriptions 

The state of a quantum system is described by a density matrix, which can also 
be seen as an ensemble of state vectors each of them having a classical probability 
of appearance. This view has given the starting point for the development of 
Monte Carlo simulation methods for Markovian [301 I3T1 1321 133] and non-Markovian 
[T3| [26| [27J |3U [35j [361 E3 EH EH] open quantum systems in which the time evolution of 
each state vector in the ensemble contains a stochastic element. One of these methods 
for Markovian dynamics is the Monte Carlo wave function (MCWF) method which 
exploits quantum jumps [3H] . 

The MCWF quantum jump method is probably the most commonly used Monte 
Carlo method for treating Markovian open systems whose dynamics is governed by 
the master equation in the Lindblad form of equation (fl]). To unravel the master 
equation ([T]) one has to generate an ensemble of stochastic state vector realizations 
whose deterministic and continuous time evolution is interrupted by randomly occurring 
quantum jumps. The average over the ensemble of stochastic realizations gives the 
reduced system at any given moment of time. One can write the density matrix in 
terms of the ensemble of state vectors as 

p(t) = J2 I ^\Mt)}(Mt)\, (6) 

where N a (t) is the number of ensemble members in the state \ip a (t)) at time t and iV is 
the total ensemble size. 

The method proceeds in discrete time steps 5t and a single time step that takes 
us from time t to t + St. During the time step, a given state vector \ip a (t)) evolves 
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either in a deterministic way or performs a randomly occurring quantum jump. The 
deterministic evolution is given by the non-Hermitian effective Hamiltonian 

% = 5-jE7*, (7) 

where the operators are the Hermitian operator H and the Lindblad operators Lj in 
Eq. Q. The deterministic time-evolution by the effective Hamiltonian ([7]) gives for a 
single time step the state 

\</> a (t + St)} = (l - iH eS 5t) \Mt)} , (8) 

after which the state is renormalized. If, on the other hand, a quantum jump to channel 
i occurs, the state vector changes in a discontinuous way 

!*.(«)> !*,(* + *)> = n^T^ir- (9) 

The probability p l a for a state vector \ip a ) to have a quantum jump to channel i is given 
by 

tf a {t)= li 5t^ ol {t)\L\L i \^ a {t)). (10) 

Now, let us consider the non-Markovian case. For simplicity, we assume the 
Lindblad operators in the local in time master equation ^ to be time- in dependent. 
The difference to equation Q is that the time dependent decay rates get temporarily 
negative values. One can directly see from equation ( 10 ) that whenever the decay rate 
is negative one cannot apply the MCWF quantum jump method, since one would end 
up with negative jump probabilities. However it is possible to develop another jump 
description for the non-Markovian case, inherently different from the Markovian one 

The deterministic evolution is equivalent to the Markovian case, i.e. given by 
equations §f§ and Q [27J. Also, whenever the decay rate in channel % is positive the 
corresponding jump can be produced as the Markovian one. However, when the decay 
rate in channel i turns negative, memory effects start to play a role and the jump method 
described in equations ([£]) and (10) can no longer be used. Indeed, for a negative channel 
% the direction of the jump process gets reversed 

\Va'{t)) || 

and the jump operator for the negative channel i takes the form 

D^it) = \1>At)) {Mt)\ , 

where the source state of the jump is \ip a (t)) = Li \i/; a >(t)) /\\Li \i/; a >(t)) ||. Thus, the 
source and the target states of the jump get swapped as the decay rate becomes negative. 
Further the probability for a reversed jump for a given state vector \ip a ) is given by 

pL«> = ^§1^)1^ Au liM*)> • (ii) 

Note that if there are no ensemble members in the target state, N a > = 0, the jump 
probability is equal to zero. 
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3. Misbeliefs about local in time equations 

The local in time equations of the form given in equation ^ with temporarily 
negative decay rates give a natural extension of the Markovian equation Q to the 
non-Markovian regime. The negative decay rates arise naturally, when no Markov 
approximation is made in the microscopic derivation of the master equation. They have 
been widely applied to non-Markovian problems in physics, but there are still many 
misunderstandings related to the applicability and interpretation of these equations. 
In this section we pinpoint some of these misunderstandings and through some simple 
examples clarify these points. 



3.1. Negative decay rates and positivity of the density matrix 

A naturally arising question is whether the dynamics remains physical when the 
Markovian master equation ([!]) is extended to the non-Markovian regime where 
temporarily negative decay rates arise. The physicality of the process refers to the 
question of whether the master equation produces physical states, when the input state 
is physical. In the quantum realm this boils down to the question, whether the resulting 
dynamical map is completely positive for each time t. The complete positivity of the 
dynamical map is a more strict requirement than the positivity of the output state, i.e., 
whenever the map is completely positive the output states must be positive as well. 

It is well known, that the Markovian master equation (JTJ produces completely 
positive dynamical maps for all times. However this requires the positivity of the decay 
rates. When the decay rates are temporarily negative there exists no general proof, that 
the resulting maps would be completely positive. However, if further assumptions on 
the properties of the decay rates are made, the requirement of complete positivity is 
met. In order to further illustrate this statement let us consider a simple example of a 
two-level system with a single channel. 

The general master equation for a single channel process of a two-level system with 
the Lindblad operator a_ = \g) (e|, where {|e} , \g)} is a system basis, is 

j t p(t) = j(t) (a-p(t)<r + - *K<7_, p(t)}) , (12) 
where ^(t) is an arbitrary function with temporarily negative values. For simplicity we 



take the system Hamiltonian H = 0. Equation (12) can be easily solved to give the 
dynamical maps describing the process for time t 

p{t) = «(t) Pee (0) |e> (e| + (1 - K(t)p ee (0)) \g) (g\ 

+ K (t) 1 / 2 (p eg (0)\e)(g\+ Pge (0)\g)(e\), (13) 
where n{t) = exp — / y(s)ds . One can proof that the dynamical maps for different 



times t given by equation (13) are completely positive if and only if J / y(s)ds > for 



all times t. Thus in order for the master equation (12) to describe a physical process 



the decay rate ^(t) needs not to be positive but only it's integral has to be. Therefore, 
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in general, master equations with negative decay rates do produce physical processes, 
when certain additional constraints are met. 

3.2. Negative decay rates and jump probabilities 

In the previous section we demonstrated, that negative decay rates in a time local master 
equation can produce completely positive dynamical maps, i.e., that they do describe 
physical processes. A natural question arising is, how to interpret the negative decay 
rates. For the Markovian case, with positive rates, the interpretation is straightforward 



when one follows the line of thought of the jump unraveling of section 2.2 the decay 



rate gives the rate at which jumps from the source state to the target state of the 



corresponding channel occur and thus the jump probabilities given in equation (10) are 
directly proportional to decay rate. 

A misunderstanding regarding the interpretation of the negative decay rates occurs, 
when one tries to use the Markovian logic in the non-Markovian case: one quite easily 
makes the false conclusion, that the negative decay rate only reverses the direction of 
the process between the state vectors. However, one can quite easily figure out, that 



this is not enough: in the non-Markovain jump unraveling of section 2.2 the direction 



of the process is reversed, but also the jump probabilities are different: As we can see 



in equation (11), the jump probability is not only proportional to the absolute value of 
the decay rate, but also to the ratio of the occupation numbers N a >(t)/N a (t) given by 
the state of the system at the time of the jump. In particular, the jump probability 
is proportional to the occupation number of the target state, which carries information 
about the state of the system at previous times. Thus, whenever the decay rate is 
negative one can define an effective rate for the reversed jumps given by 

which depends on the state the system at time t and therefore also on the earlier 
states of the system. The simple reversal of the jump process, without changing the 
jump probabilities would naturally not produce a non-Markovian process. The effective 



decay rates in equation (14) however encode the history of the process and thus allow 
memory effects in the dynamics. In the following section we will discuss memory effects 
described by local in time equations in detail, but first we will explore the concept of 
effective decay rates in the classical case. 

Assume we have a classical stochastic process described by the rate equation Q. 
When the rates 7&j(t) are positive, the terms with a positive sign represent probability 
gain to the state k and the terms with a negative sign represent loss. Let us now consider 
a gain term jki(t)pi(t) and assume ■jnit) < 0. Now, the term can be rewritten 

lki(t)pi(t) = ~hki(t)\ I) ^Pk(t) = -%i(t)p k (t), 

Pk{t) 

and we see that the gain term with the negative rate 7&{(t) actually describes a loss 
term with an effective positive rate %i = l7fc/(0l^m- Thus, also in the classical case, 
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the negative decay rate describes a reversed process with an effective decay rate, which 
depends also on the earlier states of the system. 



3.3. Local in time equations and memory effects 

The fact that equation (|3]) is local in time, i.e., there is no integration over the past 
states of the system in the master equation often creates a misunderstanding that the 
equation can not describe memory effects. However, the classical counterpart of the 
equation immediately shows that this is not the case whenever there are negative decay 
rates: The rate equation with positive rates is a straightforward consequence of the 
Markov property. Thus, whenever one cannot write a rate equation with positive rates 
for the process, it cannot fulfill the Markov condition. Therefore, the process must be 
non-Mar kovian. The classical case acts as a simple demonstration of the fact that local 
in time equations with negative decay rates indeed describe memory effects. 

To further demonstrate the memory effects induced by negative decay rates, let us 
study a simple example of a two-state system and compare the probability flow in the 
non-Markovian and corresponding Markovian cases. We denote the probability to be 
on state 1(2) at time t by pu 2 )(t). Let us first study a Markovian model, where the rate 
equations are 

\ P2= Jl(t)pi(t) - J2{t)p 2 {t) 

and the decay rates are 

' r o < t < si 



7i (t) 





r 



S\ < t < s 2 
s 2 <t < s 3 





r 

o 



0<t<s x 
Si < t < s 2 
s 2 <t < s 3 



This is a process, where the direction of the probability flow changes periodically due 
to two alternating channels with opposite direction, but there are no memory effects. 

The corresponding process with memory effects has only one decay rate ~f(t) for 
the transitions 1—^2 with a negative region for Si < t < s 2 , i.e., j(t) = ji(t) — 72 (t)- 
As discussed in the previous section, for the period of time with the negative decay rate 
we can rewrite the equation in terms of an effective decay rate, which in this case is 
72 (t) = 72(^)^2^) an d the rate equation reads 

Pi = -l(t)pi(t) = T 2 (t)p 2 (t) " li(t)Pi(t) 

In figure [I] we have plotted p\ (t) for both the processes as well as the effective decay 
rate 72 (t) for T = 0.4 1/s, s\ = 5 s and s 2 = 10 s. We can see a substantial qualitative 
difference in the Markovian and non-Markovian cases. Naturally both the processes 
coincide for t < 5 s. In this region the different initial values start to approach a 
stationary value independent of the initial state. For t > 5 s, the negative decay rate 
occurs for the non-Markovian process and the two processes diverge from each other. For 
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Time t [s] 



Figure 1. Markovian (M) and Non-Markovian (NM) two state model for different 
initial states Pi(0) = 1,0.5,0 and for T = 0.4 1/s. The upper panel describes state of 
the system as a function of time. Solid lines are for the Markovian and markers for the 
Non-Markovian model. In the lower panel we plot the time dependent rates for the 
Markovian model (dashed and dotted lines), the positive rate for the Non-Markovian 
model (dotted line) and the effective rate for the Non-Markovian model (markers). 
Color and marker coding matches to upper panel. The effective rate for pi(0) = 
(circles) is zero for all times and therefore not displayed in the plot. 

the Markovian process probability distributions corresponding to different initial values 
still approach each other, since the decay rate is independent of the initial state. For the 
non-Markovian process, the effective decay rate 72 (t) depends on the earlier states of the 
system and therefore the different probability distributions, corresponding to different 
initial states, diverge from each other when the decay rate is negative and signify the 
presence of memory effects. In the non-Markovian case the evolution for t > 5 s is a 
reflection of the history of the state: the system starts approaching the initial state by 
reversing the process which occurred in the past. In contrast, for the corresponding 
Markovian process the system does not account for the past but continues to approach 
a common stationary value independent of the initial state. The most striking difference 
between the two processes can be seen, when the initial state is chosen to be pi(0) = 0. 
For this initial value, in the Markovian case pi(t) starts increasing. However, for the 
non-Markovian process pi(t) = for all times t, since the effective decay rate is zero for 
all times; one cannot reverse jumps that never occurred. In the next section we further 
explore different characteristics of classical non-Markovian processes described by local 
in time equations. 
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4. A classical non-Markov chain 



A finite continuous time Markov chain is a process X(t),t > with values in 0, 1, 2, N, 
such that given the present, the past and future are independent, i.e., for all s,t > 
and all states i,j,x(u) the Markov condition |JT] 

P(X(t + s) =j\X(s) = i,X(u) = x(u),0< u<s) 
= P{X(t + s)=j\X(s) = i) (15) 

is fullfilled. The Markov property of equation ( Jl5| ) guarantees, that such a process is 
described by a rate equation Q, where all the rates 7m (t) are positive. A straightforward 
generalization of such a process to the non-Markovian regime can be made by allowing 
the rates to get temporarily negative values. Naturally, in this case, the condition of 



equation ( 15 ) is no longer fulfilled. To see some characteristic features of such processes, 



let us study the ring configurations of figure [2j 




Figure 2. The Markov and non-Markov chains considered in the text. The single 
headed arrows describe a positive rate and the double headed arrows rates oscillating 
between positive (black head) and negative (white head) values. 



We denote the rates for jumps to the clockwise direction as Aj : i+i(t). Rates for the 
jumps to the opposite direction are denoted by Now, the probabilities Pi are 

solutions to the following system of ordinary differential equations 

Pi(t) = ~ Pi(t) (Aj,i+i(t) + iii,i-i(t)) 

+ Pi_i(i)Ai_i,i(i) + p i+ i(t)fM +1) i(t). 

We study a ring configuration consisting of four states and choose the initial state as 
Pi(0) = 1. First we consider the non-Markovian ring configuration presented in figure 
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Figure 3. The dynamics of the ring configuration of figures |2ja) (non-Markovian) 
and[2]jb) (Markovian). Initial state for both the Markov and the non-Markov chains 
ispi(0) = 1. r = \ 1/s. 



[2]^a).We take the rates to the anti-clockwise direction to be zero and the rates to the 
clockwise direction to be equal: Xi^+iit) = r(t) with the rates given by 



where 



r(t) = f(t)-g(t), 

f(t) = ir (1 + sgn[cos(r7rt - u /2)}) , (16) 

g{t) = *r(l + sgn[cos(r7r* + 7r/2)]) 

and T is a positive constant. The rates are periodic and get temporarily negative 

values and thus the system is a non-Markov chain. The dynamics conserves the 

positivity, which is easy to check, e.g., by exploiting the change of variable yi{t) = 

exp fQr(s)ds Pi(t). When r(t) < the non-Markov chain performs transitions in the 

anti-clockwise direction with the effective rates 

~ Pi-i(t) 
X^(t) = —\r(t)\. 

In the corresponding Markovian case presented in figure |2](b), where the negative rates 
are replaced by positive rates to the reversed direction, we have A»,i+i (t) = f(t) for the 
clockwise jumps and fj, iti _i(i) = g{t) for the anti-clockwise jumps. 

In figure [3] we compare the Markov and the non-Markov chains. We see that the 
Markov chain has a steady state p% = \ which the system reaches independent of the 
initial state as t — > oo.The non-Markov chain has a stationary distribution Pi= \, but 
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since the positive and negative periods have same amplitude and periodicity the non- 
Markov chain will never reach the stationary state; the periods of negative rate always 
evolve the system back to the initial state. 

As another example we consider a ring configuration of figure |2](c) with two rates, 
the one always positive, and the other oscillating between positive and negative values. 
The initial state of the system is p\(0) = 1. In the non-Markovian case we have a 
constant clockwise rate A iii+ i (t) = T, and a periodic anti-clockwise rate r(t) defined as 

r(t) = f(t)-g(t), 



where f(t) and g(t) are defined in equation (16). Thus the functional form of the 
non-Markovian rate is the same as in our previous example but now anti-clockwise. 
Hence, jumps to anti-clockwise direction take place with rates = T and 

/Xj 5 j_i(t) = periodically while jumps to the clockwise direction occur periodically 
alternating between T and the effective rate T + |r(t)| p ^ffl = A iji+ i(t) + 

In the corresponding Markovian case, presented in figure (2^d), we have the rates 
K,i+i(t) = T + g(t) and = T — g{t). The clockwise rate thus takes values Y and 

2r and the anti-clockwise rate V and periodically. The system has again a stationary 
state with Pk(t) = |, which is reached for all initial states as t — > oo. Also, as we can see 
in figure [4], the non-Markovian process reaches the stationary state. This is due to two 
competing processes present in the non-Markovian case: the constantly positive rate 
drives the system towards the stationary state and the oscillatory rate tries to bring the 
system towards the initial state. 

The difference in long time behavior of the two non-Markovian processes presented 
in this section can be seen from the behavior of the effective rates plotted in figure [5] 
We see that in the first example the effective rates differ greatly from the corresponding 
Markovian rate independent of how much time has elapsed. In the second example the 
constantly positive rate drives the effective rates towards the corresponding Markovian 
value. At later times the effective rates do not differ from the Markovian one. So even 
though the negative rate is periodic and the magnitude and period do not change in 
time, the effect of it dies out. 



5. Conclusions 



As the need for engineering and controlling open quantum system for quantum 
information applications has increased in the recent years, efficient methods for treating 
non-Markovian dynamics are required. The local in time description of non-Markovian 
dynamics with efficient simulation methods allows a relatively simple treatment for 
memory effects. Even though the local in time description has been introduced already 
more than thirty years ago and successfully applied to many non-Markovian problems, 
nevertheless there has been many misunderstandings related to the applicability of these 
equations. 

In this paper we have discussed these misunderstandings and through examples 
clarified many aspects related to time local equations. We have also considered classical 
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Time t [s] 

Figure 4. The dynamics of the ring configuration of figures [2jc) (non-Markovian) 
and[2]jd) (Markovian). Initial state for both the Markov and the non-Markov chains 
ispi(O) =1. r = | I/s. 
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Figure 5. Effective rates of the non-Markovian ring systems. In panel a) we have 
the case of figure [2ja). In panel b) we have the case of figure [2^c). 
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stochastic processes, which can be derived as a special case of the quantum master 
equation. We showed that negative decay rates in the master equation do not prevent 
the complete positivity of the corresponding dynamical map. Further, we demonstrated 
that the negative decay rates do not only describe a reversal of a process but, also affect 
the transition probabilities in the process reflected in effective decay rates describing 
the dynamics. We compared the two cases with positive and negative rates in order to 
emphasize that local in time equations with negative rates describe memory effects. 

Non-Markovian local in time equations have not yet been extensively used in the 
context of classical stochastic processes. In this paper we used a local in time description 
for modeling a non-Markov chain influenced by memory effects. The non-Markovian 
extension shows many interesting dynamical features absent in the well known Markov 
chain. We found that the stationary behavior of the process can change drastically, 
when memory effects are present: instead of reaching a unique stationary state, the 
system may repeatedly return to its initial state. We expect that application of the 
local in time description in the classical realm could open new venues of research also 
in the theory of classical stochastic processes with a variety of applications. 
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